(19) 



J 



Europfitseh ~^atentamt 
European l^atont Office 
Office europten dee brevets 



ill 


Dl 


ill 


ill 



(12) 



(43) Date of publication: 

02^)1^4 Builetin2004A)1 



(11) EP 1 376 392 A2 

EUROPEAN PATENT APPUCATiON 

(51) Intci7: G06F 17/24. G06F 17/27 



(21) Application number 03012432.5 

(22) Date of fiyng: 30.05.2003 



(84) Designated Contracting States: 


• SawlcKI, Marcin 


AT BE BQ CH CY CZ DE DK EE ES Fl FR GB GR 


Klrlcland,WA 98034 (US) 


HU IE IT LI LU MC NL FT RO SE SI SK TR 


• Jones, Brian M. 


Designated Extension States: 


Redmond. WA 98052 (US) 


ALLTLVMK 


« Uttle, Robert A. 




Redmond, WA 98053 (US) 


(30) Priority: 27.06.2002 US 184298 


• Pratley, Christopher H. 




Seattle, WA 98109 (US) 


(71) Applicant: MICROSOFT CORPORATION 


• Broman, Paul 


Redmond, WA 98052 (US) 


Renton, WA 98056 (US) 


(72) Inventors: 


(74) Representative: Qr8necker, KInkeldey, 


• Reynar, Jeff rey C. 


Stockmalr & Sehwanhiusser Anwaltssozletit 


Woodinvllle. WA 98072 (US) 


Maximlllanstrasse 58 




80538 MQnchen (DE) 



(54) Method and system for associating actions with semantic labels in electronic documents 



(57) A method and system are provided for associ- 
ating actions with semantic labels In an eiectronic doc- 
ument. The document is created or edited in an appli- 
cation program module and sections of the electronic 
document are annotated with semantic labels. The ap- 
plication program module passes the semantic labels to 
an action Dl±. The action DLL Is responsible for com- 
municating with the application program module, trans- 



mitting the labels to action plug-ins, and receiving, from 
the action plug-Ins, the actions to be associated with the 
labels. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the sennantic labels and displays them to a user. 
The document may be created In extensible Markup 
Language (XML) and may be annotated using XML 
tags. The semantic labels may be associated with 
strings of text or graphteal objects 
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Description 
Field of Inventton 

[0001 ] The present invention relates to a method and 
system for associating actions with semantic labels in 
an electronic document. 

Background of the Invention 

[0002] Electronic documents such as word process- 
ing documents, e-mail messages, and spreadsheet 
documents typically include semantic Inf omiation which 
may be recognized as belonging to a particular semantic 
catego7 and associated with one or more actions rele- 
vant to the catego^. Recognition and use of this seman- 
tic infomiatbn provides Increased Interoperability be- 
tween desktop software applications and other desldop 
applications and/or web-based applications. Exemplary 
functions, features, and operations may Include auto- 
maticaiiy addressing an e-malt messagSi perfomilng a 
look up In a cooperating database, providing a hyperlink 
to one or more Internet web pages and providing en- 
hanced content. 

[0003] One cun^nt scheme for recognising strings in- 
volves utilizing an application program module to pass 
a string of text (e.g.. a paragraph) entered into an elec- 
tronte document to a recognizer. The recognizer parses 
the string for known keywords which are then compiled 
into semantic categories. Each recognized string Is then 
labeled with the title of the semantte category to which 
it belongs. For example, when a user types the string 
•Bob Smith" which is known to the recognizer as a key- 
word, the recognizer compiles the string into the seman- 
tic category iabeted "name." After the string has been 
compiled, the appiicatton program module may display 
to the user a selection of actions associated with the 
semantk: category label In the electronb document. For 
example, the semantk: category label "name" may be 
associated with the action "Add name to contacts foid- 
er.- 

[0004] Independent software developers are often not 
in the best position to determine all of the semantic in- 
formatran that Individual users need to be recognized in 
electronic documents. Cun"ent schemes, however, are 
limited In that they require strings of text In the electronic 
document to contain keywords which are known to a 
recognizer to Incorporate semantic category labels and 
make actions available to the user. That Is, If a string of 
text (e.g., a person's name) does not match a list of key- 
words known to the recognizer, the string will not be la- 
beled as a semantic category and no actions will be as- 
sociated with the string. Moreover, current schemes are 
further limited In that they are unable to recognize and 
associate actions with non-string data (e.g., Images, 
photos, drawings, and other (nsertable objects) whteh 
may be In a document. 

[0005] Thus , there is a need for a method and system 



for allowing actions to be associated with ertitrery 
strings or other types of content, such as images, pho- 
tos, drawings and otfier insertable objects tn an elec- 
tronic document without the need for recognition. 

5 

Summary of the Invention 

[OOOe] illustrative embodiments of the present Inven- 
tion satisfy the above described needs by providing a 
to method and system for associating actions wim seman- 
tically labeled strings of text or other content without the 
need for recognition. 

[0007] In one embodiment, the present invention pro- 
vkles a method for associating actions with semantk: la- 
bels in an electronb document. When the document Is 
created or edited tn an appibatlon program module, sec- 
tions of the electronk; document are annotated with se- 
mantic labels. In the present embodiment, the docunnent 
may be created using extensible Maricup Language 
PCML) and the semantic labels may be XML tags. The 
applicatk)n program module then passes the labels to 
an action DLL. The action DLL is re^nsible for com- 
munbating with the application program module, trans- 
mitting the labels to actbn plug-Ins, and receiving, from 
the actbn plug-ins, the actions to be associated with the 
labels. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the semantb labels and displays them to a user. 
The sen^antlc labels may be associated with strings of 
text or graphical objects. 

[0008] These and otherfeatures, advantages, and as- 
pects of the present invention may be nrwre cleariy un- 
derstood and appreciated f onn a review of the following 
detailed description of the disclosed embodiments and 
by reference to the appended drawings and claims. 

Brief Description of the Drawings 

[0009] 

Fig. 1 is a block diagram of a computer that provides 
the exemplary operating environment for the 
present Invention. 

Fig. 2 is a block diagram illustrating an exemplary 
architecture for use In conjunction with an embodi- 
ment of the present invention. 
Fig. 3 is a flow chart Illustrating a method for incor- 
porating seriiantlc labels and actions during crea- 
tion of an electronic document tn accordance with 
an illustrative embodiment of the present invention. 
Rg. 4 is a flow chart Illustrating a method for asso- 
ciating actions with semantic labels in accordance 
with an illustrative embodiment of the present in- 
vention. 

Detailed Description of Illustrative Embodiments 
[0010] The present Invention is directed toward a 
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method end system for associating actions with seman- 
tic labels in an eiectronlc document 
[0011] In one embodiment the Invention is Incorpo- 
rated into a suite of application programs refened to as 
'OFFICE," and more partlcularty Is incorporated into a 
word processing application program entitled "WORD" 
and a spreadsheet application program entitled "EX- 
CEL," both marketed by Microsoft Corporation of Red- 
mond, Washington. Briefly described, the application 
programs allow a user to create and edit electronic doc- 
uments by entering characters, symbols, graphical ob- 
jects, and commands. 

[0012] In one embodiment, the present Invention In- 
cludes associating actions with semantic labels In an 
electronic document. When the document is created In 
an application program module, sections of the electron- 
ic document are annotated with semantic labels. The 
application program module then passes the labels to 
an action DLL. The action DLL Is responsbie for oonv 
municatlng with the application program module, trans- 
mitting the labels to action plug-Ins, and recehring, from 
the action plug-ins, the actions to be associated with the 
labels. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the semantic labels and displays them to a user. 
[0013] Having briefly described an Illustrative embod- 
iment of the present Invention, an illustrative operating 
en\^ronmenl for the present Invention Is described be- 
low. 

Exemplary Operating Environment 

[0014] Referring now to the drawings, in which like nu- 
merals represent like elements throughout the several 
figures, aspects of the present Invention and the exem- 
plary operating environment will be described. 
[0015] Fig. 1 and the following discussion are intend- 
ed to provide a brief, general description of a suitable 
computing environment In which the Invention may be 
innplemented. While the Invention will be described in 
the general context of an appiicatton program that runs 
on an operating system in conjunction with a personal 
computer, those skilled In the art will recognize that the 
invention also may be Implemented In combination with 
other program modules. Generally, program modules In- 
clude routines, programs, components, data structures, 
etc. thatperform partteular tasks or Implement particular 
abstract data types. Moreover, those skilled in the art 
will appreciate that the invention may be practiced with 
other computer system configurations, including hand- 
held devices, multiprocessor systems, microprocessor- 
based or programmable consumer electronk:s, cell 
phones, minicomputers, mainframe computers, and the 
like. The Invention may also be practiced in distributed 
computing environments where tasks are perfonned by 
remote processing devices that are linked through a 
communications network. In a distributed computing en- 
vironment, program modules may be located in both lo- 



cal and remote memory storage devices. 
[0016] With reference to Rg. 1 , an exemplar system 
for implementing the Invention includes a conventional 
personal computer 20, Including a processing unit 21 , a 

9 system memory 22. and a system bus 23 that couples 
the system memory to the processing unit 21 . The sys- 
tem memory 22 Includes read only memory (ROM) 24 
and random access memory (RAM) 25. A basic Inputs 
output system 26 (BIOS), containing the bask: routines 

10 that help to transfer Information between elements with- 
in the personal computer 20, such as during start-up, is 
stored in ROM 24. The personal computer 20 further In- 
cludes a hard disk drive 27, a magnetic disk drive 28, e. 
g., to read from or write to a removable disk 29, and an 

r^ optical disk drive 30, e.g., for reading a Ci>ROM disic 
31 or to read from or write to other optical media. The 
hard disk drive 27. magnetic disk drive 28, and optical 
disk drive 30 are connected to the system bus 23 by a 
hard disk drive interface 32, a magnetic disk drive Inter- 

20 face 33, and an optical drive interface 34, respectively. 
The drives and their associated computer-readable me- 
dia provide nonvolatile storage for the personal compu- 
ter 20. Although the description of computer-readable 
media above refers to a hard disk, a removable mag- 

25 netic disk and a CD-ROM disk, It shouM be appreciated 
by those skilled In the art that other types of media whch 
are readable by a computer, such as magnetic cas- 
settes, flash memory cards, digital video disks, Bernoulli 
cartridges, and the like, may also be used in the exem- 

30 piary operating environment 

[0017] A number of program nrndules may be stored 
In the drives and RAM 25, Including an operating system 
35, one or more applk^ation progranns 36, a word proc- 
essor program module 37 (or other type of program 

35 module), program data 38, and other program modules 
(not shown). 

[0018] A user may enter commands and infonmatton 
Into the pereonal computer 20 through a keyboard 40 
and pointing device, such as a ntouse 42. Other Input 

40 devices (not shown) may Include a microphone, joy- 
stick, game pad, satellite dish, scanner, or the like. 
These and other Input devices are often connected to 
the processing unit 21 through a serial port Interiace 46 
that is coupled to the system bus, but may be connected 

45 by other Interiaces, such as a game port or a universal 
serial bus (USB). A monitor 47 or other type of display 
device is also connected to the system bus 23 via an 
interiace, such as a video adapter 48. in addition to the 
monitor, personal computers typically include other pe- 

50 ripheral output devices (not shown), such as speakers 
or printers. 

[0019] The personal computer 20 may operate in a 
networked environment using logical connections to 
one or more remote computers, such as a remote com- 
55 puter 49. The remote computer 49 may be a server, a 
router, a peer device or other common network node, 
and typically Includes many or all of the elements de- 
scribed relative to the personal computer 20, although 
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only a memory storage device 50 has been illustrated 
in Figure 1. The logical connections depicted In Rgure 
1 include a local area network (LAN) 51 and a wide area 
network (WAN) 52. Such networking environments are 
commonplace In offices, enterprise-wide computer net- 
works. Intranets and the Internet. 
[0020] When used In a LAN networking environment, 
the personal computer 20 is connected to the LAN 51 
through a network interface 53. When used In a WAN 
networking environment, the personal computer 20 typ- 
ically Includes a modem 54 or other means for estab- 
lishing communk^ations over the WAN 52, such as the 
tntemet. The modem 54, which may be internal or ex- 
ternal, is connected to the system bus 23 via the serial 
port interface 46. in a networked environment, program 
modules depicted relative to the personal computer 20, 
or portions thereof, may be stored In the renr>ote memory 
storage device. It will be appreciated that the network 
connections shown are exemplary and other means of 
establishing a communications link between the com- 
puters may be used. 

[0021] Rg. 2 is a bk>ck diagram illustrating an exem- 
plary architecture 200 for use in conjunction with an em- 
bodiment of the present Invention. The architecture In- 
cludes an application program module 205, such as 
word processor program module 37 (Rg. 1). The appli- 
cation program module 205 is able to communicate with 
an action dynamlc-llnk library 215 (hereinafter action 
DLL) as a user Is creating, editing, viewing, etc. an elec- 
tronic document. An action Is a user-initiated function 
applied to a typed atrfng or other content such as imag- 
es, photographs, or drawings. The acdon DLL 215 con- 
trols a nunnber of action plug-Ins 225. The action DLL 
also controls a type-action database 230. 
[0022] In an illustrative embodiment, the action plug- 
Ins are Automation Senders. Automation Senders are 
well-known software components which are assembled 
into programs or add functionality to existing programs 
mnning on the Mtorosoft WINDOWS® operating sys- 
tem. Automation Servers may be written in a variety of 
computing languages and may be un-plugged from a 
program at run time without having to recompile the pro- 
gram. 

[0023] The action DLL 215 manages the action plug- 
Ins 225 that are njn to execute the actions. The action 
plug-Ins 225 may be packaged with the application pro- 
gram module 205 or written by third parties to perfonn 
particular actions that are of Interest to the third party. 
The action plug-Ins provide possible actions to be pre- 
sented to the user based upon the type label associated 
with the string or other content. The action DLL 21 5 de- 
temilnes what type label the semantic category Includes 
and cross-references the type label in the type-action 
database 230 with a list of actions to detemilne what 
actions to present to the user. It should be. understood 
that, in an ftlustratfve embodiment, the type-action da- 
tabase is not used. Instead, the list of actions is dynam- 
ically generated for each type by looking in the registry 



to determine which actbns ara Installed and then que- 
rying the action DLLs to detemilne which types they ap- 
ply to. 

[0024] After the user chooses an action, the action 
s DLL 215 manages the appropriate action piug-ins 225 
and passes the necessary information between the ac- 
tion plug-Ins and the application program module 205 
so that the action plug-in may execute the desired ac- 
tion. Typically, the application program module sends 
10 the action DLL an automation request to invoke the ac^ 
tion the user has selected. 

[0025] A download URL may be provided with the 
type labels in case the user's nr^hlne has not stored 
action plug-ins for these type labels. If the user does not 
r5 have the action plug-in DLL 225 con^espondlng to a la- 
bel, then the download URL may be used to navigate 
the user^ web browser to an appropriate website to 
download this action plug-in. In other Implementations 
of the Inventton, multiple downtoad URLs may be pro- 
20 vided for a single type label. 

[0026] Having described an exemplary architecture, 
an exemplary method 300 for semantlcalty labeling 
strings during document creation will be described be- 
low in reference to Rgs. 2 and 3. 

IMethod for Incorporating Semantic Labels and 
Actk>n8 during Document Creation 

p>027] Fig. 3 is a flow chart Illustrating a method 300 
for incorporating semantic labels and actions during cre- 
ation of an electronic document. Those skilled in the art 
will appreciate that this is a computer-Implemented 
process that is cam'ed out by the computer In response 
to input from the user and instructions provided by a pro- 
gram module. In this en^bodlment. the user may be a 
software developer. 

[0028] Refening to Rg. 3, the method 300 begins at 
start step 305 and proceeds to step 310 when the de- 
veloper creates the electronic document in appncatlon 
program module 205. tn one embodiment of the present 
Invention, the document nnay t)e in a template format 
allowing a user to input strings of text, or other content, 
such as an lavage, photo or drawing, relevant to the doc- 
ument. For example, If the document is a wilt template, 
the document may have sections for the user to input 
infomiatlon such as name, place of residence, executor 
of the estate, and beneficiaries. Or if the document is a 
news article, the document may have sections for the 
user to Insert a related photo. Or If the document is a 
business publication, it may have sections for a logo 
graphical .element, in an illustrative embodiment, the 
electronic document is a word processing document or 
a spreadsheet document. However, the method Is not 
limited to either of these specific types of electronic doc- 
uments. 

[0029] At step 310, sections of the document are an- 
notated with semantic labels which are to be associated 
with actions built by the developer. For example, if the 
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document being created Is a win template having a sec- 
tion that requests a person's residence and that section 
Is annotated with the semantic label 'Place of Resi- 
dence," then actions for the "Place of Residence" label 
wll) be available for that section regardless of the text 
string Input by the user. In one embodiment of the 
present Invention, the document is created in XML and 
annotated using XML tags to label the document The 
XML may be written using any editing tool orXML editing 
tool. For example, the residence section of the will tem- 
plate would be annotated with the <plaoe of re8idence> 
XML element. The method 300 then proceeds to step 
315. 

[0030] At Step 31 5, the developer b ullds action plug- 
ins 225 to provide and execute the actions for each se- 
mantic label (e.g., XML element) In the annotated doc- 
ument. Aftera string is labeled with a particular semantic 
label, the user will be able to execute action plug-tns 
pertaining to that label. For example, for the "Place of 
Residence' label In a will document, the developer may 
build actions which provide the user with the option to 
review the laws relating to wills which are particular to 
the user's state of residence. The method 300 then ends 
at step 399. 

Method for Associating Actions with Semantic 
Labels 

[0031] Fig. 4 is a flow chart illustrating a method 400 
for associating the created semantic labels with the ac- 
tion plug-ins 225 discussed in Rgs. 2 and 3 above. 
Those skilled In the art will appreciate that this Is a com- 
puter-intplemented process that is carried out by the 
computer In response to input from the user and Instruc- 
tions provided by a program module. 
[0032] Referring to Fig. 4, the method 400 begins at 
start step 405 and proceeds to step 410 when a user 
opens an electronic document (e.g., the will template 
described in Fig. 3) in application program module 205. 
In one embodiment, the electronic document is a word 
processing document or a spreadsheet document. 
However, the Invention is not limited to either of these 
specific types of electronic documents. 
[0033] At step 415, the user hovers a cursor over a 
string or places the insertion point within a string In a 
section of the document incorporating a semantb label 
causing a dropdown menu to be displayed to the user 
In step 420. The dropdown menu typically displays a list 
of actions associated with a semantic label. The drop- 
down menu typically appears above and to the left of 
the semantic label. For exanple. If the user types the 
string 'Redmond, Washington' in the section labeled 
"Place of Residence" the dropdown menu might display 
an action allowing the user to review the law relating to 
wQls in the state of Washington. It should be understood 
that the application program module 205 sends a re- 
quest to the action DLL 215 to detennine which actions 
are shown with each semantic label. The method then 



proceeds to st^ 425. 

[0034] In one embodiment of the Invention, applica- 
tion program module 205 may Include the option to dis- 
play an in<locument user Interface to Indicate the loca- 

5 tion of a semantic label. This In-document user Interface 
may use a colored Indication to Indicate the location of 
a semantic label such as brackets or underlining. For 
example, if the user types the string 'Redmond, Wash- 
ington' In the section of the document labeled as a se- 

10 mantk: category with type label "Place of Residence,' 
the document may look like this with the bracks indi- 
cating semantic labeling: 

[Redmond, Washington] 

15 ^ 

[0035] Of course, the ln<k)cument user interface may 
be any sort of Indication. 

[0036] At step 425, the user Is gh^en the optbn of se- 
lecting one of the actk)ns from the dropdown menu dis- 
played In step 415. If the user does not select an actloh, 
the dropdown menu remains displayed until the user po- 
sitions the cursor or Insertion point to another section of 
the document. If the user does select an action from the 
dropdown menu (l.e., by clicMng on a selection), the 
method proceeds to step 430. 
[0037] At step 430, after the user has selected an ac- 
tion, the action DLL retrieves the selected action from 
the appropriate action plug-in. The action pfug-lns pref- 
erably are COM objects that are executed via commu- 
ntoation between the application program module and 
the action DLL. Parameters necessary to execute the 
action (the XML markup of the string labeled as being 
of a partteular type, the XML markup of the content rep- 
resenting the cunrent selection) will be passed from the 
application program module to the action DLL and, in 
turn, passed to the action plug-in. After an actton has 
been executed, the method returns to step 410 in whid) 
the user may repos Itio n the cu rso r o r hover over another 
semantk: label in the document The method 400 then 
ends at step 499. 

[0036] In another embodiment, actions may be asso- 
ciated with sections of existing documents. For exam- 
ple, a court might receh/e a legal document, such as a 
property deed, in electronic form. The property deed 
may already have a specific structure such as the loca- 
tion of the property, the amount paid, and a description 
of the property boundaries. A developer may annotate 
the stnjcture of the document with semantic labels in a 
particular schema (e.g., XML) and build actions to pro- 
vide functionality for particular elements of the schema 
that appear in the document Thus, an action associated 
with the location section of the deed may cause a map 
showing the property to be displayed. 
[0039] Although the Illustrative embodiments of the 
present invention have been described as implemented 
in a word processing program module, it should be un- 
derstood that the present invention may be implement- 
ed in other program modules, including, but not limited 
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to. XML authoring programs and programs such as the 
•POWERPOINT presentation graphics program, the 
"VISIO" dlagrani drawing program and applications in- 
eluded in the •OFFICE" program module, both marketed 
by Microsoft Corporation of Redmond, Washington. 
[0040] The architecture of embodin^ents of the 
present invention is designed to allow developers to pro- 
vide actions for labeled strings or other content such as 
graphical objects which may Include, for example, inr>- 
ages, photographs, or drawings. JhB strings or other 
content may be associated with actions without the need 
for recognizer DLLs or recognizer plug-ins which are 
limited because they are string based and thus do not 
accurately recognize non-string content. The developer 
may annotate sectbns of the document with semantic 
labelsao that the actions will be available no matter what 
is Inserted in the annotated section by the user The ar- 
chitecture also allows developers to write less code to 
provide actions since no recognition is required. 
[0041] it should be understoodthat Illustrative embod- 
iments of the present Invention are designed to be able 
to function without any action plug-in DLLs. For exam- 
ple, if there are no action plug-In DLLs, then the user 
may be presented with a menu Item that allows the user 
to go to a download site to Install an action plug-in DLL. 
[0042] Although the present invention has been de- 
scribed above as Implemented In illustrative embodi- 
ments, It wilt be understood that altemative embodi- 
ments will become apparent to those skilled in the art to 
whteh the present Invention pertains without departing 
from Its spirit and scope. Accordingly, the scope of the 
present Invention is defined by the appended daftns 
rather than the foregoing description. 



Claims 

1 . For an electronic system for creating and editing an 
electronic document, a method for associating ac- 
tions with semantk) labels In the electronic docu- 
ment created In an application program module, the 
method comprising the steps of: 

annotating the electronic document with a plu- 
rality of the semantic labels; 
receiving the plurality of labels In an action dy- 
namic link library; 

transmitting the plurality of labels to a plurality 
of action plug-Ins; and 

determining, In the action plug-ins, a plurality of 
actk>ns based on the labels. 

2. The method of claim 1, wherein the step of anno- 
tating the electronic document with a plurality of se- 
mantic labels comprises annotating the electronic 
document with a plurality of extensible Markup Lan- 
guage (XML) elements. 



3, The method of claim 1 , further comprising display- 
ing the plurality of actions received f nom the action 
plug-Ins. 

5 4. themethodof claim 1, wherein the plurality of ac- 
tions are predetennined for each of the piuralily of 
labels. 

5. A method for associating actions with content In an 
10 electronic document as the electronic document is 
created in an a application program module, the 
method comprising the steps of: 

as the content Is entered into the electronic 
IS document, associating the content with a se- 

mantic label, wherein the electronic document 
is annotated with a plurality of sennantte labels; 
and 

detemnlnlng a plurality of the actions assodat- 
20 ' ed with the label 

e. The method of claim 6, further comprising display- 
ing an indication that the label has been found for 
the content . 

25 

7. The method of claim 6, further comprising the steps 
of: 

determining that a user has selected the con- 
$0 tent; and 

in response, displaying the plurality of actions 
to the user. 

8. The method of claim 5, further comprising the steps 
35 of: 

receh^lng an Indication that one of the plurality 
of actions has been selected; and 
in response to receiving an Indication that one 
40 of the piuralify of actions has been selected, 

then causing the application program module 
to execute the selected action. 

9. The method of daim 5, wherein the step of assocl- 
45 ating the content with a semantk; label comprises 

associating a string of text with the semantic label. 

10. The method of daim 5, wherein the step of associ- 
ating the content with a semantic label comprises 

so associating a graphk^ai object with the semantic la- 
bel. 

11 . The method of claim 8, wherein the application pro- 
gram module executes the selected action by de- 

ss tenninlng whether an action plug-In dynamic link li- 
brary assigned to the action is available; and 

if so, then receiving Instmctions from the ac- 
tion dynamic link library assigned to tiie selected ac- 
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tion. 

12. The method of claim 11. further oompilsing the 
steps of: 

if en action plug-In dynamic linic llbraiy is not 
available, then using a Unifomn Resource Lo* 
cator assigned to the action to navigate to a 
Web site and download the action ptug-ln d/- 
namic link l&>rary. 

13. A system for associating actions with semantic la- 
bels in an electronic document, the system compris- 
ing: 

an application program module for annotating 
the electronic document with a plurality of the 
semantic labels; 

an action dynamic link library connected to the 
application program module receiving the plu* 
rallty of labels; and 

a plurality of actk>n plug-ins connected to the 
action dynamic link library for receiving the plu- 
rality of labels and detemilning a plurality of ac- 
tions based on the labels. 

14. The system of claim 1 1 , wherein the semantic labels 
ere extensible ^4a^kup language (XML) elements. 

15. The system of claim 1 1 further comprising a display 
module for receiving and displaying the plurality of 
actions received from the action plug^ns. 

16. For an electronk: system for creating and editing an 
electronic document, a computer-readable medium 
having computer-executable instructions for asso- 
ciating a plurality of actions with semantic labels In 
the electronk: document created in an application 
program module, comprising: 

annotating the electronic document with a plu- 
rality of the semantic labels; 
receiving the plurality of labels in an action dy- 
namto link library; 

transmitting the plurality of labels to a plurality 
of action plug-ins; and 

determining, In the action plug-ins, the plurality 
of actions based on the labels and displaying 
the plurality of actions received from the plural- 
ity of action plug-ins. 

17. The computer-readable medium of claim 12, where- 
in annotating the electronic document with a plural- 
ity of semantic labels comprises annotating the doc- 
ument with a pluretity of extensible Markup Lan- 
guage (XML) elements. 

18. A computer-readable medium having computer-ex- 



ecutable instojctlons for a^oclatlng actions with 
content In an electronic document as the electronic 
docunriem is created in an a application program 
module, comprising: 

5 

as the content is entered into the electronic 
docunient, associating the content with a ae- 
mantb label, wherein the electronic document 
is annotated with a plurality of semantic labels; 
10 and 

detemnlnlng a plurality of the acttons associat- 
ed with the label; 

receiving an indication that one of the plurality 
of actions has been selected; and 
IS in response to receiving an Indication that one 

of the plurality of acttons has been selected, 
then causing the application program module 
to execute the selected action. 

^ 19. The computer-readable medium of dalm 1 8, where- 
in associating the text with a semantic label com- 
prises associating the text with an extensible 
Markup Language (XML] element 

2s 20. The computer-readable medium of claim 1 8, f urttie r 
comprising displaying an indication that the label 
has been found for the content. 

21 . The computer-readable medium of claim 1 8, where- 
to In ^e application program module executes the se- 
lected action by detemrvning whether an action 
plug-in dynamic link library assigned to the actbn 
Is available; end 

if so, then receiving Instructions from the ac- 
S5 tion dynamk; link library assignedto the selected ac- 
tion. 

22. The computer-readable medium of dalm 18, where- 
in associating the content witii a semantic label 

40 comprises associating a string of text with the se- 
mantto label. 

23. The computer-readable medium of claim 1 8, where- 
in associating the content with a semantic label 

45 comprises associating a graphical object with the 
semantk; label. 

24. The computer-readable medium of claim 20. further 
comprising the steps of: 

50 

if an action plug-in dynamic link library is not 
available, then using a Uniform Resource Lo- 
cator assigned to the action to navigate to a 
Web site and download the action plug-in dy- 
55 namic link library. 

25. For an electronic system for creating and editing an 
electronic document, a method for associating ac- 
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tions with extensible Markup Language elemente 
(XML) In the electronic document created In an ap- 
plication program module, the nnethod comprising 
the steps of: 

5 

annotating the electronic document wfth a plu- 
rality of the XML elements; 
receiving the plurality of XML elements In an 
action dynamic link library; 
transmitting the plurality of XML elements to a 10 
plurality of action plug-Ins; and 
detemnining, In the action plug-Ins. a plurality of 
actions based on the XML elements. 

26, The method of claim 25. further comprising display- is 
Ing the plurality of actions received from the action 
plug-Ins. 

27. The method of claim 25, wherein the plurality of ac- 
tions are predetennlned for each of the XML ele- ^ 
ments. 
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